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ABSTRACT 

This report presents Iowa's performance indicators of 
program quality in adult basic education (ABE) programs and describes 
the process by which they were developed. The performance indicators 
fulfill the mandate of the National Literacy Act of 1991 to serve as 
indicator s of program quality. They were developed through a 
comprehensive process that included the participation of adult 
education administrators and practitioners, adult learners, 
researchers, and other experts in the field, and they take into 
account the different conditions under which the broad array of local 
programs operate. The performance indicators fall under two general 
topic areas: program process and content, and student outcomes. 
Program process and content refers to components of th? program that 
define how it operates, such as program planning, student 
recruitment, intake, assessment, staff characteristics, curriculum 
and instructional content , materials and equipment , assessaient of 
student progress, evaluation, and follow-up. Student outcomes refers 
to the impact of the program on students, such as lear- mg gains and 
goal attainment. The guide contains 9 indicators of program quality, 
26 performance measures, and 33 performance standards. Six 
appendixes, which make up half the docuiiient, include the following: a 
description of the initial development of performance measures; a 
memorandum of approval of performance indicators by ABE coordinators; 
first draft of performance standards; ratification of performance 
standards by ABE coordinators and adult education deans and 
directors; a chronological listing of continuing education, ABE, and 
General Educational Development accountability studies; and a policy 
paper in support of regional delivery systems. (KC) 
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Preface 



For more than 25 years (1965-1993), the Adult Education Aa has supported sutes* efforts to provide lifelong 
learning opportunities for educationally disadvantaged adults. Adult basic education CABK), adult secondary 
education (ASZ>f and English-as-a-Second Language CESL) programs have allowed adult learners to reach d>etr 
full potential as parents, woikeis, and citizens of their communities. 

The National Literacy Act of 1991 renewed the federal commitment to adult education. Foremost among its 
priorities is the improvement of programs to ensure that educational services supported with federal fimds are 
quality services. To this end, the National literacy Act called for the development of indicators of program 
quality by the Secretary of Education that could be used by states and local programs as models by which to 
judge the effectiveness of their services. 

The peiformanoe indicators, presented in this report, fulBQ that mandate. They were developed through a 
comprehensive process that included the participation of adult education administrators and practitioners, adult 
learners, researdiers, and other experts in the field They have taken into account the differeiu conditions under 
which the broad array of local programs operate. Both die indicators themseWes, and the process by whidi they 
were developed, guided Iowa's adult basic education coordinators as they developed and refined Iowa's quality 
indicators to meet the requirements of the National Literacy Act 

As a new centurjr approaches, Americans will kieed higher levels of literacy than ever before. The National 
Uteracy Aa chalfer^ges aU of us invdved in adub basic education and Ite 

met The performance indicators represent a first and critical step in our efforts to define and promote quality in 
programs that serve as the foundation for ensuring the successful achievement of national educational goal 
number five which states: "liy the year 2000, every adult AnieticanwiU he literate 
knowledge and skills occcsaary to compete in a national gtobal ccooomy aod cxerdge the rights aad 
rqyonslbaities of dtiaenship.** 
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Overview 



The Adult Education Act CAEA) estaUishes the federal role in supporting the provision of basic skills instruc- 
tion to educationally disadvanuged adults. Hie Act authorizes the U.S. Depaitment of Education to provide 
basic grants to states that support local instruction to adults in adult basic education (ABK), adult secondary 
education OSS>, and En^ish^a^second-language CESD prpgiams. The Act also promotes quality in state 
and local poQgnuns throu^ requiftments for program evaluation. The most leoent amendments to the Act, 
embodied in the National literacy Aa (>n^ of 1991, highUght the ii^ 
ingthat 

Within one year after the enactment of the National Uteracy Act of 1991, the Secretary, in 
consulution with appropriate expeits, educators and administrators, shall develop indicators 
of pipgram quality that may be used by State and local programs receiving assistaiKe under 
this title as models by which to judge the success of such programs, including success in 
recruitment and retention of studerus and improvement in the literacy sld'Js of students. Such 
indicatocs shall take into account different a)tKlitions under which progr^ins operate and 
shall be modified as better means of assessing program quality are developed (Section 361(c) 
of the Aduk Education AcO. 

In addition, the National Literacy Aa requires that sutes develop and imi^ement their own indicators of 
program quality to be used to evaluate programs assisted imder this title to determine whether such pro- 
grams are effective, including ^diether sudi programs are successfully recruiting, retaining, and improving the 
literacy skills of the individuals served in such progra*^" (Section 331 [al2) of the Adult Education AcO. 
Ihelndkatofsiniistbeliili^^ Sutes have 

until July 1993 to develop and implement their indicators. 

Ihis report presents Iowa's performance indicators of program quality and descnl)es the process by which 
they were devek>ped The Iowa Department of Education, Division of Community Colleges, had responsibil- 
ity for this process, 

Tlie perfomumoe indicators developed through this process have taken into accoura the different conditions 
under which Iowa's adult basic education programs operate and will be modified as better means of assessing 
program quality are identified Their prirnary purpose is to pra^de the slate and local pro^^ 
perlbnnaaoe Indicatota bjr which to |imI^ the tucccsa of their programs, lliese indicators represent 
the elements that the Iowa Department of Education, based on consultation with the field, views as essential 
to ensure high-quality services in adult basic education and literacy programs. 

Quality Indicators, Measures and Performance Standards 

The National literacy Act spedf^d that indicators were to be developed in the areas of recruitment, retention, 
and learning gains. In addition, the U.S. Department of Education identified two general topic areas for 
whidi indicators were to be developed: pfqgrampf^^ Program 
process and conterUttftn to components of the program that define how it operates, such as: (1) program 
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planning, (2) fecmitment of students, (S) intake, (4) assessment, (5) staff characteristics, (6> cuniculum and 
instructional content, (7) materials and equipment, (8) assessment of student progress, (9) evaluation, and 
(10) follow-up. Student outcomes refers to the impact of the program on students, such as learning gains and 
goal attainment 

To guide the development of Iowa's performance indicators, a framework for the quality indicator develop- 
ment process was e^ablished utilizing the national model developed by Pelavin Associates for the U.S. 
Depaitment of Education. It was especially impoitant to distinguish quality indicators from performance 
measures and peiformance sundards. Ihe three terms are often used interchangeably, yet they differ con- 
ceptually. Defining them clarified the development process and the meaning of a quality indicator. 

Definition of Terms 

The following definitions were adopted from the definitions referenced in the national model developed by 
Pelavin Associates for the U.S. Depaitment of Education. 

QuaUty IndUMor. A quality indicator is a variable that reflects effective and efficient program performance. 

P§%J6r m mmc0 Measurt. A performance measure is defined as the dau or process used to determine the 
quantitative or qualitative level of perfomiance. 

r^vJb$ ' tm$Kt Stamdard. A measure with a specific numeric criterion, qualiutive sutement or level of 
performance tied to it A performance standard defines a level of accepuble performance for a specific 
peifonnance measure or darifies a process ^en a performance measure is viewed as qualitative. There are 
three types of performance standards: 1) quantiutive, 2) qualitative, 3) a combination of quantitative and 
qualiutive. A quantiutive standard define a specific numeric criterion or a level of performance. A qualiutive 
standard defines a process or series of activities. A qualiutive standard is used to qualify a process oriented 
performance measure. In some cases, a performance standard may be classified as a combination of quantiu- 
tive and qualiutive. 

Criteria for Formuiation of Appropriate Performance Standards 

Ihe criteria utilized for formulation of Iowa's perfonnanoe standards were: 

1) Does the performance sundard describe a qualiutive process? 

2) Does the peribrmance standard describe numeric criteria or performance levelCs) (quantiutive)? 

3) If the performance standard describes a process; which research repoits, memoranda, or oQxex 
documenution accurately qualifies that process? 

O If the performance standard describes numeric criteria or performance leveKs), which trend dau 
accurately quantifies that numeric criteria or performance leveKs)? 

5) Does the standard reflect generally accepted sutewide program practices as opposed to local 
program practices? 

6) Is the standard equiuble, appropriate, and achievable for Iowa's Adult Basic Education program 
based on long term trends? 
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Timeframes 



The timeframes for fomiulation, development and implementation of the perforaiance standards wete as 
follows: 



Event 



Date 



1. Initial national perfomianoe indicators 

developed and approved by Pelavin Associates 
for U.S. Depaitmeni of Educatioa 

Z Initial development of sute performance 
indicatois induded in the Amendments to 
Iowa's Plan for Adult Basic Education for 
Fiscal Years 1993-1995. 

3. Development and refinement of Iowa's 
performance measures based on the Pelavin model. 
ISee Appendix A] 

4. Approval of performance measures 

by ABE Coordinators. [See Appendix B.] 

5. First draft of performance standards. 
[See Appendix C] 

6. Approval of perfomiance standards. 
ISee Appendix a] 

7. Dissemination of performance standards. 

8. Implementation of performance standards 
In Iowa's adult basic education programs. 



Fa>ruary-July, 1992 

July 1992 

Septembers. 1992 

November 19. 1992 

FdtMuary 10. 1993 

Mard^l993 
April-July 1995 

July 1993 
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The Iowa Context 



The formulation of Iowa's adult basic education program performance indicators utilized the national 
performance indicators developed by Pelavin Associates, Inc, for the U.S. Department of Education, Division 
of Vocational and Adult Education. The Iowa standards* committee, a sub-committee .of the adult basic 
education coordinators* group, reviewed the Pelavin model and made appropriate modifications and 
revisions which reflected the reality of program practices inherent in Iowa's adult basic education programs. 
The performance measures were twice reviewed and modified by the standards' committee. The adult basic 
education coordiruitors approved the performance measures after the two revisions by the standards' 
committee. 

The next task of the standards' committee was the formulation and development of quantifiable and/or 
qualifiable performance standards based on the approved performaiKe measures. The standards' committee 
revised the performance standards twice prior to submission to the adult basic education coordiiutors for 
final revisions and approval. The performance standards vere then submitted to the adult deans and direc- 
tors' association for review and approval prior to implementation of the standards for program evaluation 
purposes. 

During the formulation and development of the performance standards, the standards' committee utilized 
several data sources to serve as documentation for the geriests of the performance standards. The major data 
sources utilized in the formulation and development of the performance standards were: (1) Iowa's State Plan 
and Amendments for Adult Basic Education: Fiscal Years 1990-1995, (2) The Adult Basic Education Federal 
Annual Program Performance Report, G) The General Educational Development Testing Service (GEDTS) 
and the Iowa GED Annual Sutistical Reports, (4) The Iowa High School Equivalency Diplomas daU base 
developed by the Iowa Department of Education, (5) a variety of policy memoranda, developed by the Iowa 
Depaitment of Education, outlining program practices and procedures on various aspects of adult basic 
education program and suff development activities, (6) 1990 federal census dau, (7) a variety of research and 
accounubility studies conducted on various aspects of Iowa's ABE/ESI/GED program. [See Appendix R] 

Throughout the entire process of standards articulation, many persons and organizations were involved in the 
formulation, development and review of the performance standards. Ihis process has assured the field of 
adult basic education in Iowa that the performance sundards quantify or qualify the reality of accepuble 
performance of the many and varied aspects of meeting the intent of national education goal number five 
which sutes: liy the year 2000, every adult American will be literate and will possess the knoid- 
edge and skills necnsary to compete in global economy and exercise the rights and responsibili* 
tics of citizenship." 
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Iowa's Adult Basic Education 
Performance Measures and • 
Perforrnance Standards 



Performanca Standards' Philosophy 

The perfomunoe standards for Iowa's adult basic education programs weie developed with a philosophy and 
goal of program improsremem and acoounubility. Ihe performance standards repiesent the phOosof^cal and 
practical yardstick by ^ch Iowa's adult basic education programs will be Judged and evaluated Ihe perfor* 
manoe standards also represents the effectiveness of an integrated system for tlie delivery of basic skills education 
to Iowa's aduk populous through the community cdlege continuing education network Several recent, national 
research studies have conduded that states idildi faa^ 
ability aadclfcc Umi cit as op|M)gcd to 
/See Appendix Fi 

Performancs Standards' Process 

The perfoniiance standards, listed on the foUov^dng pages, have two separate components: (1) a listing of focus 
areas, indicators, performance measures, and performance starkbrds, (2) the dau source for each staxKiaid. In 
order to effecthrely articulate the process of performarKe standards development, the standards' committee 
formulated perfonnanoe standards for aU focus areas. Ihe reader wiU note on the fo "JowalsAduU 
Bask:E(b4catkmPeffamafic^ the source 

documentation and type of standard are identified 

It should be noted that two of the performance standards (1.12.1 and 1.22.1) simply state that the standard is to be 
determined for future program needs. The reason for this is due to the faa that a specific strategy for competency 
basis educatk>n has not, as yet, been iritegratediritocurremprograrxmiirig efforts. However, sinoei^ 
important performance measure, it is a concept to be explored in the future. 

Analysis 

An analysis of the performarice standards indicates the following observations: 

1. There are nine (9> indicators of program quality. 

2. There are twenty-six OS) performance measures. 

3. ll)ere are thirty-three (33) performance standards. 

4. The performance standards are classified according to the 
following taxonomy. 

a. Twehe (12) are quantifiable. 

b. Thirteen (13) are qualifiabte. 

c Six C$) are a combination of quantifiable/qualifiable. 

d Two CO are unclassified since they represent future 
strategies. 
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utilization of Pdrformanco Standards 



The petformatioe standards presented in this repoit fulfill the federal mandate of the National Litefaqr Aa As 
stated in the Act, they can be modified as better means of assessing program quality are developed Hiey provide 
invaluable guidance to the states, local programs, the field, and policymakers at all levels. 

For Iowa's community college adult basic education programs, the performance standards and the process used 
in their development has added another measure of accouiuability. 

For local prognuns, the performance standaids offer a dear and concise method of judging the success of their 
programs and promoting program improvement 

For the field, the performance standards oGfer a focus for basic and applied leseardi, innovative practices, 
evaluative studies, and tedhnicalassistanoe efforts. [See Appendix E] 

For policymakers, the peiformanoe standards provide better, more appropriate, and moce accurate informatksn 
on the effectiveness of Iowa's adult basic education programs and delivery system — information that will en- 
hance their undeistandirv; of the value of Iowa's community colleges continw system. 
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Epilogue 



Indicatocs of program quality provide dear and unambiguous methods for assessing the success of a program in 
meeting goals. They promote program improvement by pointing to areas of excellence and weakness. Ideally, 
indicators will help all users of adult basic education services and those responsible for administering them. 
Policy makers could use the information from indicators to formulate decisions. Administrators could assess the 
effectiveness of programs to improve them to better meet the needs of the adult clientele and the community. 

landmaric repon has served as a one in a series of acoxintabiUty studies ^ 
See Appendix E] With the advent of the 1990's, accountability and proactiveness will be the conceptual banner 
around yMch Iowa's community colleges' adult and continuing educatocs will rally. This report has dearly 
demonstrated the excellence and quality of programs currently being offered. 

It is then the challenge of Iowa's adult basic education programs to maintain these high standards of excellence, 
quality, irmovativeness, accountability and proactiveness diroughout die 1990's arul into the twenty-first century. 



4^2 



FRir 



APPENDICES 



APPENDIX A 
Initial Development of Performance Measures 




TERRY E. BRANSTAD. governor DEPARTMENT OF EDUCATION 

WILLIAM L. LEPLEY. Eo.D.. DIRECTOR 



MEMO: 


93.005 


DATE: 


Septembers, 1992 


TO: 


Aduit Basic Education Performance Standards' Committee 


FBOM: 


Bureau of Educational and Student Services 


SUmECT: 


Development of Iowa's Adult Basic Education Performance Measures 




and Performance Standards 




Introduction 



The purpose of this memorandum is to review the discussion on the September 3» 1992 confer- 
ence call ^th members of the adult basic educaticKi perfcMinance standards' committee. I have 
enclosed background information that should be of help in getting us started on the task of devel- 
oping and refining Iowa's performance measures and performance starxlards. 

Goal 

The major goal of the performance standards' committee is to review the existing performance 
measures and integrate the results of the Pelavin Associates' study in with the performance mea- 
sures Iowa has already developed. In addition, the committee will develop the necessary perfor- 
mance standards to quantify the performance measures. Our objective is to have the total task 
completed and ratified by the ABE cocxdinators at the ABE coordinators' retreat In June. 

Process 

The following process should be followed in reviewing the performance indicators: Each subcom- 
mittee has been assigned to review a specific focus area. The committee should review their focus 
area in terms of the performance measures. If there are any additional performance measures that 
should be added or any that you feel should be deleted from the Pelavin list, please feel free to do 
so. However, justification should be documented as to the reasonCs) for deletion of a performance 
measure. This process should be completed by November 1, 1992. The information that you 
have accumulated should be sent back to me no later than October 20, 1992. This will enable me 
to pull together all of your input and send out the second draft of the document by Noi^ember 1» 
1992. 

(over) 
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Please feel free to contact your req>ective committee members by telephone or by personal visita- 
tion. If you would like to set up a meeting with each other, feel free to use staff development 
funds. Reimbursement of expenditures would be throu^ the standard ATr-l/ATr-2 process. 

Once the committee has come to ccxisensus on the actual performance measures, the next task will 
be to develop specific perfcxmaiK^e standards for eadi one of the performance measures. 

Sumnuoy 

Hopefully the entire process will go smoothly as we do have some time to work on this paiticular 
project It is important since the next re-authorization of the Adult Education Aa CFY '95) will 
require that we have actual performance standards in place for our program. 

If you have any questions, please feel free to contact any committee member. 



Sincerely, 



John Haitwig, Consultant 
Division of Commimity Colleges 

JH/bse 
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APPENDIX B 



Approval of Performance Indicators 
by ABE Coordinators 




TERRY E. BRANSTAD. governor DEPARTMENT OF EDUCATION 

WILLIAM L. LEPLEY. ED.D.. DIRECTOR 



MEMO: 


93.010 


DATE; 


November 2, 1992 


TO 


Adult Basic Education Coordinators 


FROM: 


Bureau of Educational and Student Services 


KE: 


Second Draft of Indicators of Program Quality and Performance Measures 



Introduction 



The purpose of this memorandum is to present the second draft of Iowa's adult basic education 
performance indicators of program quality and performance measures for review and ratification at 
the November 19, 1992 ABE coordinators' telenetwork meeting. 

The meeting wUl be spent discussing, reviewing and ratifying the indicators of program quality and 
the performance measures. A roll odl vote will be taken on the ratification process. 

Background 

As you are aware, one of the major priorities of the adult basic education coordinators, for FY '93, is 
to formulate the performance indicators and performance standards for Iowa's adult basic educa- 
tion program. In order to accomplish this ta^, a subcommittee of the ABE coordinators, entitled 
the standards' committee, was formed to loc^ at the existing performance indicators developed by 
the adult basic education coordinators during FY '91 and also to incorporate the national perfor- 
mance indicators which were developed by Pelavin Associates for the United States Office of 
Education. 

The following is a listing of the focus areas and committee members: 



Focus Area 

Educational Gains 
Program Planning 
Curriculum/Instruction 
Staff Development 
SuppcHt Services 
Recruitment/Retention 



Committee Members 

John Hartwig - Laura Schinnow 
Kay Nebergall - Marty Lundberg 
Georgie Klever - Linda Rater 
Dona Eckhardt - Jane Hobart 
Don Wederquist - Jane Hobart 
Joan Rourice - Karmen Shriver 
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The National Literaqr Aa of 1991 renewed the federal commitment to adult education. Foremost 
among its priorities is the imix'ovement of programs to insure that educational services supported 
with federal funds are quality services. To this end, the National Literacy Act called for the develop- 
ment of indicators of program quality, by the secretary of education, that could be used by states 
and local programs as models by which to judge the effectiveness of their services. 

Each state was given the option to develop their own performance indicators using the national 
performance indicators as a model. The committee has finished their development aiKi review of 
the indicators of program quality and accompanying performance measures. The committee's next 
task will be to develop the performance standards, once the iiKiicators of program quality and 
performance measures are reviewed and ratified by the adult basic education coordinators. 

ProccM 

Each committee will review their respective focus area at the November 19, 1992 telenet meeting 
allowing time for input, questions, revisions and clarification. Upon the final review of all areas, the 
committee will then ask that the indicators of program quality and performance measures be 
ratified with any corrections by the ABE coordinators. 

At that point, the next major step will be to begin work on the performance standards which is a 
separate but related process to tiie development of the performance measures and indicators of 
program quality. 

Summary 

The committee has gone through two drafts of the attached document. The committee is in agree- 
ment that this document represents our best effort As we developed the performance indicators 
and performance measures, we attempted to keep those indicators which best reflect current and 
future program practices for adult basic education in Iowa. The committee is asking that each 
coordinator critically review the materials prior to the November 19th telenetwork meeting. By so 
doing we will have your best thinking and input. If you have any questions, prior to the 
telenetwork meeting, please contaa myself or any member of the committee. * 

Sincerely yours, ^ ^ 



John Hartwig, Consultant 
Division of Community Colleges 

}HA)SC 
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TERRY E, BRANSTAD. governor DEPARTMENT OF EDUCATION 

WILLIAM L. LEPLEY. Ed.D.. DIRECTOR 



MEMO: 93.014 

DATE: November 19, 1992 

TO: Adult Basic Education Perfonnance Standards' Committee 

EKOM: Bureau of Educational and Student Sendees 

SUmECT: First Draft of PerfcMmance Standards 



Introduction 

The purpose of this memorandum is to i^-esent the model for the development of Iowa's adult basic 
education performance standards for discussion at the December 9, 1992 standards' committee 
telenetwork meeting from 1:00 to 3:00 p.m. 

Background 

The formulation of performance irKlicators has evolved through three (3d phases. The first phase 
was to formulate the indicators of program quality and performance measures. Hie second phase 
was ratification by the ABE coordinators at the November 19, 1992 telenetwork meeting. The third 
phase is now the formulation of the performance standards. 



Definition 



A performance standard is defined as: a measure with a specific numeric criterion, qualitative 
statement or level of performance tied to it. A performance standard defines a level of acceptable 
performance for a specific performance measure or clarifies a process ^en a perfonnance measure 
is viewed as qualitative. Ihere are three types of perfonnance standards: 1) quantitative, 2) qualita- 
tive, 3) a combination of quantitative and qualitative. A quantitative standard define a specific 
numeric criterion or a level of performance. A qualitative standard defines a process or series of 
activities. A qualitative standard is used to qualify a process oriented performance measure^ In 
some cases, a performance standard may be classified as a combination of quantitative and qualita- 
tive (see 1.31.1). 



(over) 
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Memo 93.014 
Page 2 



ProoeM 

In order to articulate the process for performance standards development, Laura Schinnow and I 
have formulated, what we consider to be, the performance standards for focus area 1.0 (see at- 
tached documents). You will note on the sheet entitled: ''Iowa's Adult Basic Education Perfor* 
mance Indicators and Performance Standard Source Identification", we have identified the source 
documentation for each performance standard aiKi ^>edfied the type of performance standard for 
each the performance measures. 

It should be noted that two of the performance standards (1.12.1 and 1.22.1) simply state that the 
standard is to be determined for future program needs. Hie reason for this is due to the fact that we 
have not, as yet, integrated competency based strategies to our programming efforts. But, since it is 
an important performance measure, it is a concept to be explored in the future. 

Slunmary 

The purpose of providing a model to guide us through our process of developing performance 
standards is: 1) develop a unifcMtnity of language, 2) develop a uniformity of thought as to how 
different performance measures can be quantified and/or qualified, 3) articulate a consistent num- 
bering system from one focus area to the other. Since we are working in coiimiittees, it is important 
that we all do things basically the same way so that it will be easy to pull the fmal document to- 
gether for the ABE coordirutors. 

We will discuss the process of developing performance standards in detail at the December 9, 1992 
telenetwork meeting. If you have any questions, prior to the telenetwork meeting, please contact 
me. 

Sincerely yours. 



John Haitwig, Consultant 

Bureau of Educational and Student Services 



JH/bse 
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DEPARTMENT OF EDUCATION 

WILLIAM L. LEPLEY. Eo.D.. DIRECTOR 



MEMO: 93.020 

DATE: December % 1992 

TO: Adult Basic Education Performance Standards' Committee 

FROM: Bureau of Educational and Student Services 

SUmECT: Update on Develc^ment of Performance Standards 



Introduction 

The purpose of this memorandum is to reiterate the major points from the December 9, 1992 
Tdenetwork meeting. The major points were: 

1) The fust draft of the performance standards, and source documentation, 
are to be sent to me by January 20, 1993. 

2) The next telenetworic meeting, of the standards* committee, will be 
Felxuary 10, 1993, from 2:30 to 4:30 p.m. The purpose of the telenetwork 
meeting is to review the first full draft of the performance standards and 
develop ftiture strategies. 

3) Each committee should apply the "criteria for formulation of appropriate 
performance standards", to each one of their respective standards, to 
assure that all criteria are met 



CritcHa for FormulaUon of Appropriate Pcrfo rm aacc Standards 

The criteria for formulation of appropriate performance standards are: 

1) Does the performance standard describe a qualitative process? 

2) Does the performance standard describe numeric criteria or performance 
leveKs) (quantitative)? 

3) If the performance standard describes a process; which research reports, 
memoranda, or other documentation accurately qualifies that process? 
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4) If the performance sundard describes numeric criteria or performance 
leveKs), which trend data accurately quantifies that numeric criteria or 
performance leveKs)? 

5) Does the standard reflect generally accepted statewide program 
practices as opposed to local program practices? 

6) Is the standard equitable, appropriate, and achievable for Iowa's Adult 
Basic Education program based on long term trends? 



Summary 

The committee now has the appropriate information needed to formulate the first full draft of the 
performance standards. If you have any questions, during the formulation of the standards or 
desire to have conference calls with each other, please let me know. 

Sincerely yours, 



John Hartwig, Consultant 
Divisior> of Community Colleges 

JH/bse 
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Ratification of Performance Standards 
by ABE Coordinators 
and Aduit Education Deans and Directors 
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93.033 


Date: 


February 10, 1993 


To; 


Adult Basic Education Coordinators 


From: 


Bureau of Education and Student Services 


Subject: 


ABE Coordinators Standards Meeting 



DmoDucnoN 

The purpose of this memoraiKium is to present the final draft of the performance standards for final 
discussion and ratification by the ABE coordinators group. A special telenet meeting is scheduled 
for Wednesday, March 5, 1995 from 10:00 ajn. - 12:00 pan. 

BACKGROUND 

The fcMrmulation of performance standards has evdved through two (2) phases: 1) ratification of 
performance indicators by the ABE coordinators on November 19, 1992, 2) formulation and devel- 
opment of the perfcrnnaiKe standards by the standards' commiuee. 

Tlie purpose of the enclosed copy, of the performance standards, is for review and ratification on 
March 3, 1993- 

DEFINniON 

A performance standard is defined as: a measure with a specific numeric criterion, qualitative 
statement or level <^ performance tied to it. A performance standard defines a level of acceptable 
performance for t specific performance measure or clarifies a process when a performance measure 
is viewed as qualitative. There are tiiree types of performance standards: 1) quantitative, 2) qualita- 
tive, 3) a combination of quantitative and qualitative. A quantitative standard define a specific 
numeric criterion or a level of performance. A qualitative standard ddFines a process or series of 
activities. A qualitative standand is used to qualify a process oriented performance measur^^ In 
some cases, a performance standard may be classified as a combination of quantitative and qualita- 
tive (see 1.31.1). 

PROCESS 

In order to articulate the process for performance standards development, the committee formu- 
lated the performance standards for all focus areas (see attached documents). You will note on the 
sheets entitled: **Iowa's Adult Basic Education Performance Indicators and Performance Standard 
Source Identification," the committee identified the source documentation for each performance 
standard and specified the type of performance standard for each performance measure. 

It should be noted that two of the performance standards (1.12.1 and 1.22.1) simply sute that: the 
standard is to be determined for future program needs. Hie reason for this is due to the fact that we 
have not, as yet, integrated competency based strategies into our programming efforts. However, 
since it is an important performance measure, it is a concept to be explored in the future. 

(OVER) 
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CRITEKIA FOR FORMUIATION OF 
APPROPRIATE PERFORMANCE STANDARDS 

The aiteria the committee used for formulation of appropriate performance standards were: 

1) Does the performance standard describe a qualitative process? 

2) Does the performance standard describe numeric criteria or performance leveKs) 
(quantitative)? 

3) If the performance standard describes a process; which research reports, memoranda, 
or other documentation accurately qualifies that process? 

4) If the performance standard describes numeric criteria or performance levelCs), which 
trend data accurately quantifies that numeric criteria or performance levelCs]^? 

5) Does the standard reflect generally accepted statewide program practices as exposed 
to load program practices? 

6) Is the standard equitable, appropriate, and achievable for Iowa's Adult Basic Educaticxi 
program based on long term trends? 

ANALYSIS 

An analysis of the performance standards indicates the following trends: 

1. There are nine (9) indicators of program quality. 

2. There are twenty-sfac (26) performance measures. 

3. There are thirty-six (30 performance standards. 

4. The performance standards are classified according to the following taxonomy. 

a. Twelve (12) are quantifiable. 

b. Sixteen (10 are qualifiable. 

c. Six (6) are a combination of quantifiable/qualifiable. 

d. Two (2) are unclassified since they represent future strategies. 

SUMMARY 

The standards' committee has formulated a set of performance standards which reflect the reality of 
Iowa's adult basic education programs. After the ABE coordinators ratify the standards, they will be 
presented to the adult ucans and directors* group for final ratification. If you have any questions, 
prior to the telenetwork meeting, please contaa any committee member. 

Sincerely yours. 



John Hartwig, Consultant 

Bureau of Educational and Student Services 

JH/bse 
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A Chronological Listing of 
Continuing Education/Adult Basic Education/GED 

Accountability Studies 



STUDY 


• 'STATuS'-'' 


IMPACT 


1. The GED Experience: 
Reaching Out to People 
(Iowa Dept. of Educa- 


Completed July 1982 


Evaluated the effectiveness of 
Iowa's GED delivery system. 


2. Bright Horizons: Iowa 
GED Writing Skills PUot 
Projert Final Report 
Qowa Dept. of Edt ca- 
tion) 


Completed July 1985 
(ED 256-956) 


Determined the feasibility of 
including an essay compo- 
nent on the GED examina- 
tions. 


^ Iowa's Lttcfacv/Adult 
Basic Education Target 
Peculation Studies. Qowa 
DepL of Education) 






A. Iowa's Adult Basic ^ 
Education Students: 
Descriptive Profiles 
Based on Motivations, 
Cognitive Ability and 
Socio*E>emographic 
Variables. 


Completed May 1987 
(ED 306-^26) 


Determined the marketing 
and motivational characteris- 
tics of adult basic education 
students and reasons for 
attending the Adult Basic 
Education program. 


B. Iowa s ESL Students: A 
Descriptive Profile. 


Completed December 
1987 

(ED 29(M)49) 


j^/eiermmcci me mouv«uuiuii 
and marketing characteristics 
of Iowa's ESL students 
enrolled in Adult Basic 
Education programs. 


C. Reasons for 
Nonparticipation 
Among Iowa's Adults 
Who Are Eligible for 
ABE. 


Completed March 1989 
(ED 290-048) 

1 


Documented the reasons that 
adults who are eligible for 
Adult Basic Education pro- 
grams choose not to partici- 
pate. 




A Chronological Listing of 
Continuing Education/Adult Basic Education/GED 

Accountability Studies 













STUDY 


STATUS 




4. 


ABE/GED in Conununity 
Colleges: A Status Report. 
(U.S. Deot. of Educaticm) 


Completed June 1988 


Determine the duuracteristics 
of effective community 
oolle&e ABE/GED oroorams 
in those states that utilize 
community colleges for their 
primary delivery system. 


5. 


Iowa's Norming Study of 
the Tests of General 
Educational Develop^ 
ment 

(Iowa Depart of Educa- 
tion) 


Completed October 1989 
(ED 314^74) 


Documented the perfor- 
mance level of Iowa's GED 
candidates ixx relationship to 
a norm group di Iowa's 
graduating high school 
seniors. 


6. 


Assessing the Educational 
Needs of Iowa's Home- 
less Youth and Adults. 
(Iowa Dept. of Educa- 
tion) 


Completed December 1989 


Determined the number of 
Iowa's adult homeless and 
their educational needs. 


7. 


Assessment and Adult 
Basic Education: The 
Iowa Model 
(Iowa Dept. of Educa- 
tion) 


Completed May 1990 
(ED 321-028) 


Determined the current 
assessment procedures 
utilized in Iowa's Adult Basic 
Education programs as part 
of a measure of Iowa's 
educational accountability. 


8. 


Continuing Education 
Outcomes at Iowa's 
Community Colleges 
(Iowa Dept. of Educa- 
tion) 


Completed April 1991 
(ED 331-560) 


Provide outcome measures 
for Iowa's Adult and Continu- 
ing Education programs in 
the community colleges. 
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A Chronological Listing of 
Continuing Education/Adult Basic Education/GED 

Accountability Studies 









STUDY 


STATUS 


IMPACT 


9. Relationship of the GED 
Test to Skills Needed in 
the Workplace (GEDTS). 


Completed 1991 


Provided documentation of 
the basic skills needed in the 
workplace and the compa- 
rable skills measured by the 
GED Tests. 


10. A Two, Five and Ten- 
Year Follow-Up of Iowa's 
GED Graduates. 
(Iowa Dept. of Educa- 
tion) 


Completed Aixil 1992 
(ED 344-047) 


Provide accountability as to 
the immediate, intermediate 
and long-range impact of 
Iowa's GED instructional and 
testing program. 


11. GED Profiles: Adults in 
Transition (GEDTS) 


Completed 1992 


A series of six reports that 
present information about 
adult learners compiled from 
a national survey of people 
who took the GED Tests. 


12. National Evaluation of 
Adult Education Pro- 
grams (U.S. Dept. of 
Education: Developmen- 
tal Associates, Inc.) 


In process - anticipated 
completion date 1993 


Evaluation of the potential of 
program supported by the 
Adult Education Act. 


13. Development of perfor- 
mance indicators of 
program effectiveness. 
(Iowa Dept. of Educa- 
tion) 


Completed May, 1993 


Provided performance 
indicators of orocram effec- 
tiveness in serving the 
literacy needs of Iowa's adult 
population. 


14. National Adult Literacy 
Survey (NALS) (Educa- 
tional Testing Service) 


In process - anticipated 
completion date Fall 1993 


Measure and estimate the 
literacy abilities of Americans 
aged 16-64, according to 
race, ethnkrity, levels of 
education, gender, and other 
significant variables. 
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Ex«cutlv« Summary 
Policy Paper in Support of Rogional Dolivory Systems 



Several state adult education administratcxs who are reqxMisil^e Adult Education grants are 
proposing a wording change when the Adult Educaticxi Act is reauthorized in 1993. We are 
recommending that the language in the National literacy Aa (P,L 102-73, Section 301. (oXl)) 
that refers ID •'direcT and equitable fundir^g be amen^ 
We favor the language that describes aU of the agendes ^ 

in planning for service ddivery. However, we would prefer that the language not be so inflex- 
ible as to irKiicate that the dira:t fimdirtg must a 

Prictf to the 1991 amended language, many states delivered services regionally, crften through 
community college regions. Regional systems provide scxne <rf the following advantages: 

• existing agency and institutional partnerships; 

• access to counsding, child care and transportation; 

• More sendees for assessirig studerits with special rieeds; 

• enhanced access to techndogy; 

• access to personnel services and business services; 

• availability of ccxnputerized reccnd keeping and 

• mechanisms for collecting local and state education reimbursement fonds. 

Beginnir>g with the 1 989 Jwt^ Start final report ftom the Projea on Adult Literacy, including 
the 1992 National Governor's Association GuidOHHikfar State LIterwy Leaden 
concluding with the 1992 NatiomdEvabiatkmqfAa$iUEA4catiomIhrt^ 
every national study has concluded that states need a system that is capable of cocxdinating all 
of the providers of adult basic skills rather than a pattern of urKonnected entities. 

It is our firm belief that requiring direct fonding to come fi-om the state adversely aflFects the 
efiective regicxial planning processes we were developing prior to the 1991 AmerKknent It also 
puts anurxiue burden on state personnel thatadminister programs within a 5% federally- 
imposed administration limitatioa Our plea is for states to have the flexibility to determine 
whether foruiirig and services shodd be ceritralized or regioria^ We believe in the indusiveness 
intent erf the Amendment, butwedorK)tbeUevethatinclusivenessiscornpromisedincHirstates 
that have regional systems. 
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Introduction 



The Adult Education Act is to be reauthorized in 1993. Several adult education administrators are 
recommending revised language relative to P.L 102-73, Section 301.(0X1). The 1991 amend- 
ment directs that •'each State educational agency receiving financial assistance under this subpart 
shall provide assurance that local educational agencies, public or private nonprofit agencies, 
community based organizations correctional education agencies, post-secondary educational 
institutions and institutions which serve educaticxially disadvantaged adults will be provided 
direa and equitable access to all Federal funds provided under this subpait " 

States that have created systems regic^ delivery adult basic skills have had trouble with 
the term "direct* in the 1991 amendment Although we strongly endorse the concept of equi- 
table and diverse delivery of adult basic skills, the inplication that the state educational agency 
must provide furxiing and services •'directly* to a wide variety of institutions and agencies has 
adversely affected our delivery systems. The delivery systems developed in our states involve 
working with regional education and training agencies, such as community colleges, to provide 
adult literacy services within a r^oa The regional agencies provide services at a variety of sites 
and through various agreements and subcontracts with public and private partners in their 
regions. 

Hie new amendment requiring states to provide direct services is causing the following prob- 
lems: 

• loss of state flexibility in defining how adult basic skills will be delivered; 

• fragmentation of services; 

• loss of local matching funds from regional sources that can distribute state reimburse- 
ment on a per student basis; 

• reduction of funds to proven programs in order to fund a wider variety of programs; 

• development of competitive programs rather than cooperative systems; and 

• significant additional responsibilities for state staff who must directly provide fiinding 
and services to a variety of agencies or institutions within a district 

Some of our states have gone from funding six to fifteen regions to funding 1 00 separate pro* 
grams. Hiis requires many additional individuals to supply with information, training and other 
technical assistance related to running ABE programs. 

The following pages describe national studies that call for a systematic approach to delivery of 
adult basic skills and detail advantages of systematized delivery. 



In Defense of Systems 



Several national and slate studies conducted in the past five years have described the need for 
coordinated systems for development of adult basic skills. 

In Fon-est P. Chisman's IS^fim^ Start, he urged federal planners build on the strengths of 
the field now in place" and "to develop a system erf basic sldlls education in which providers are 
rewarded for hewing learners to achieve goals that will significantly improve their Hves.'' 

In A Guideb€Mkfar State Lttenuy Leaders: Imptementbtg an Imtegt^Oed System for 
Meeting AdtsULearmiHg Needs 1992, the National Governor's Association identified that no 
states could *'ocMne dose to achieving this goal luniveisal li^eracyl by the year 2000 as long as the 
policy, program development, arxi funding decisions made by the dozens of public and private 
agencies involved in funding literacy and basic skills programs are not part of a coordinated 
plaa" 

In Patterns €^ Promise: State €md Local Strateg^sfcr Imprc^^^ 
AdtdtEdiicatiom Progra$Hs conducted for the U.S. Department of Education by COSMOS 
Corporation 1 993, three key outcx>mes that can be found in what COSMOS called ^'integrated 
services'' (systems) are the following: implementation of student assessn^t procedures, 
2) enhancement of counseling and case managen^t services, and 3) increased attention to 
program articulatioa" 

Hie most convincing endorsement of a systems approach to adult literacy education is in 
the Natiomd EvaJuatiom qfAdidt EdacaHom Programs, conducted in 1992 for the U.S. 
Department of Education. It determined that programs that scored highest on student retention 
efforts, professionalism of staff and service integration were regional education service agencies 
and community cdleges. These systems also scored very high in the only other category evalu- 
ated, outreach services. 

Advantages of Adult Education Systems 

It is the belief of those state directors who work with regional systems that, even with the 5% 
federal limitation on state administration, adult literacy administration is manageaWe. Regional 
districts coordinate services with JTTPA, welfiare, en^loyment agencies, libraries, public housing 
authorities, community-based wganizations, Job Corps, alternative high schools and other 
providers. The regional program director can either subcontract with other providers or provide 
direct services at a variety of community sites. Regional directors meet regularly with state staff 
to coordinate curriculum, training and other issues. State-sponsored training can be extended to 
all of the various partners within a regioa 
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Some cf the many advantages that are often availaWe through our regional providers indude the 
following: 

• existing community networks and partnerships; 

• a rich array of suppcxt services such as counseling 

• access to job training programs; 

• access to child care centers; 

• availability of transpoftation; 

• services for handicapped students; 

• personnel standards, research departments, audit policies; 

• access to technology; 

• staff training resources; 

• con^uterized record keepir^ capability; arxl 

• ongoir^g partnerships with a variety of local agencies and institutions. 

Summary 

Preparers of this report do not want to alter the intertt of the National Literacy Act in any way. 
We cdebrate our 2±>ility to serve a wide mix of diverse students and organizations through our 
regional service districts. However, we are pleased with the regional processes w^ch have 
developed over time, and we want to support the continued development of the regional base 
for adult literacy delivery. We think our r^onal system leadership is mudi nx>re effective in 
distributing services throughout districts in a state. From the state level we can erKourage arxl 
fiadlitate indusiveness in local regions. 

Our intent can be accomplished by simply eliminatirig the language referring to direct funding 
of each and every type of adult literacy provider and by federal encouragement of systems 
that are part of the overall state strategy to improve individuals and communities. Any language 
related to integnues services, pcmnersh 

perhaps, be strengthened Tlie need for basic skills deUveryvwU not go avray in the near future. 
Therefore, it is time to encourage state systems of quality programs that are collaborative and 
cost effective. As long as adult basic skills are delivered by a variety of unconnected entities, 
public support, understanding and visibility will continue to be limited 



Ctontriixitors Uxiude the f<^^ 

Jki^ Coll^es^ 

North Carolina ^'T-'^?'i;t' ' * " -rr^i^^As/^ 
Doniialaoe^ OfBce ofCorrwnunity College Services, Oregon 
Maiy Aim Jadewii, Boaid <^Vocati<^ Tedinicai and Adult Education, WisoMisin 
Suzanne Griffin and Fatrfdji Green, state Board of Comnriunity CoUeges, W 



